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Abstract 

We consider the asymmetric multilevel diversity (A-MLD) coding problem, where a set of 2 K — 1 information 
sources, ordered in a decreasing level of importance, is encoded into K messages (or descriptions). There are 2 K — 1 
decoders, each of which has access to a non-empty subset of the encoded messages. Each decoder is required to 
reproduce the information sources up to a certain importance level depending on the combination of descriptions 
available to it. We obtain a single letter characterization of the achievable rate region for the 3-description problem. In 
contrast to symmetric multilevel diversity coding, source-separation coding is not sufficient in the asymmetric case, 
and ideas akin to network coding need to be used strategically. Based on the intuitions gained in treating the A-MLD 
problem, we derive inner and outer bounds for the rate region of the asymmetric Gaussian multiple description (MD) 
problem with three descriptions. Both the inner and outer bounds have a similar geometric structure to the rate region 
template of the A-MLD coding problem, and moreover, we show that the gap between them is small, which results 
in an approximate characterization of the asymmetric Gaussian three description rate region. 



I. Introduction 

In the symmetric multilevel diversity coding (MLD) problem [9], K source sequences are encoded into 
K descriptions, which are sent to the decoders through noiseless channels. These source sequences have 
a decreasing levels of importance, and each decoder has access to a non-empty subset of the descriptions. 
The goal of the encoder is to produce the descriptions such that each decoder with k available descriptions 
is able to reconstruct the k most important source sequences. The symmetric MLD problem was motivated 
by fault-tolerant storage for disk arrays and for incremental priority encoding on packet erasure channels; 
see [9] for more details. The MLD problem with three levels was solved by Roche et al. in [9], and the 
result was later extended by Yeung and Zhang [10] to an arbitrary number of levels. It was shown that 
source- separation coding^ is optimal for the symmetric problem. This means that each source sequence can 
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'This was called superposition coding in these papers. In order not to confuse this with the common terminology of broadcast channels, the 
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be compressed separately, and then the descriptions are obtained by concatenating the compressed source 
sequences appropriately. 

In this work we formulate the asymmetric multilevel diversity (A-MLD) coding problem. The problem 
can be understood as a refined version of symmetric MLD coding problem, and it is naturally applicable 
in distributed disk storage applications with asymmetric (unequal) reliabilities, in contrast to symmetric 
(equal) reliabilities which motivate the symmetric MLD problem. Similarly, for packet erasure applications, 
the erasure probabilities for the sub-packets may not be equal because the paths over which they are sent 
may have different reliabilities. As such, in both applications, we may wish to utilize not just the number of 
the encoders which are accessible, but also their identities, since the descriptions are no longer symmetric. 
Therefore, the difference between the MLD and A-MLD problem is that in the asymmetric version the 
levels of reconstruction is determined by the specific combination of descriptions available to them, not 
just the number of descriptions. 

More precisely, 2 A — 1 source sequences are encoded into K descriptions at the encoder. The 2 K — 1 
decoders are ordered in a specific way, and the goal of the encoder is to produce the descriptions such that 
the A;-th decoder is able to reconstruct the k most important source sequences, for k = 1, . . . , 2 K — 1. In this 
work, we only consider the 3-description case and provide a complete characterization of the achievable 
rate region. In particular we show that source-separation coding coding is not optimal for this problem, and 
the source sequences in different levels have to be jointly encoded (like in network coding) in an optimal 
coding strategy. We also show that the scheme using linear combinations of these compressed sequences is 
optimal. We note that various special cases of 3-description problem were studied irO [11], where, however, 
only no more than three information sources were considered. The characterization we provide in this work 
strictly subsumes those considered in [11]. 

Let us now turn to a closely related problem, namely the multiple description (MD) problem. In this 
problem a source is mapped into K descriptions and sent to 2 K — 1 decoders, just as in the A-MLD 
coding problem. The decoders are required to reconstruct the source sequence within certain distortions 
using the available descriptions. The MD rate region characterization is long-standing open problem in 
information theory with a long history [l]-[3]. Despite many important results, the problem is still open, 
even for the quadratic Gaussian case with only three descriptions. Using the intuitions gained in treating 
the A-MLD problem as well as the sum-rate lower bound for symmetric Gaussian MD problem recently 
discovered in [5], we develop inner and outer bounds for the MD rate region, both of which bear similar 

2 We would like to thank R. Yeung for bringing this work to our attention. 
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geometric structure to the A-MLD coding rate region. Moreover, the gap between the bounds is small (less 
than 1.3 bits in terms of the Euclidean distance between the bounding planes), yielding an approximate 
characterization. One surprising consequence of this result is that the proposed simple architecture based 
on successive refinement (SR) [14] and A-MLD coding is in fact close to optimality. From an engineering 
viewpoint, this suggests that one can design simple and flexible MD codes that are (approximately) optimal. 

One important observation leading to this work is the intimate connection between the multilevel diversity 
(MLD) coding problem and the MD problem observed in [7]. There we showed that for the symmetric MD 
problem, achievable rate region based on SR coding coupled with symmetric multilevel diversity (S-MLD) 
coding provides good approximation to the MD rate region under symmetric distortion constraints; perhaps 
more interestingly, the achievable rate region has the same geometric structure as that of the symmetric MLD 
coding rate region. In fact, the symmetric MLD coding result is essential for establishing the symmetric 
MD result in [7]. The result in [7] suggests a general approach in treating lossy source coding problems: 
first solve a corresponding a lossless version of the problem, then extend the results and intuitions to its 
lossy counterpart to yield an approximate characterization. This is exactly our motivation to formulate the 
A-MLD coding problem, and indeed the result given in this work further illustrates the effectiveness of this 
approach. 

The paper is organized as follows. In Section II, we introduce the notations and provide a formal definition 
of the problems. In Section III, we present the main results of the paper. We prove the main theorem for 
rate region characterization of the A-MLD problem in Section IV. In Section V, we focus on deriving the 
outer and inner bounds for the rate region of the A-MD problem. Finally, Section VI concludes the paper. 
Some of the detailed and technical proofs are given in the appendix. 

II. Notations and Problem Formulation 

In this section we provide formal definitions for both the asymmetric multilevel diversity (A-MLD) and 
the asymmetric multiple description (A-MD) coding problems. Since we need to use the result of the A- 
MLD problem when treating the A-MD problem, we may use different notations for these problems in 
order to avoid confusion. 

A. Asymmetric Multilevel Diversity Coding 

Let {(Vij, V^t, . . . , V 2 k_i t)}t=i ,2,... be an independent and identically distributed process sampled from 
a finite size alphabet V\ x V 2 x • • • x V 2 k _ x with time index t. This can be considered as 2 K — 1 pieces of 
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independent data streams, namely, {Vi^}, . . . , {V 2 K_ lt }, where each data stream is an independently and 
identically distributed sequence. The data streams are ordered with decreasing importance, e.g., consecutive 
refinements of a single source. We use V™ to denote a length n sequence of Vi, namely, V/ 1 = (V^i, . . . , Vi in ). 

Define the vector random variables Uj as Uj = (Vi, . . . , Vj) for j = 1, . . . , 2 K — 1, and Uq = 0. We use 
Uj to denote length n sequences of Uj. We may simply use U n to denote U™ K _ X = (V™, . . . , V^ r _ 1 ) for 
brevity. Note that U? is a two-dimensional array, whose elements are independent of each other along both 
directions, i — 1, . . . , j, and t — 1, . . . , n. 

The Shannon entropy rate of the source 14 is denoted by h k . We also denote the entropy of Uj by Hj, 
where the independence of sources V^'s implies 

j j 

Hj = H(Uj) = H(V U ...,Vj) = J2 H W = E h - W 

i=l i=l 

The A-MLD problem can be described as follows. Consider 2 K — 1 source sequences which are fed 
to a single encoder. The encoder produces K descriptions, denoted as Tx, T 2 . . . , T K to encode the source 
sequences. The descriptions are sent over K perfect channel. There are 2 K — 1 decoders, each has access to 
a non-empty subset of the descriptions, S C {Ti, T 2 . . . , Tk}, and wishes to decode losslessly the source 
data streams below a certain level, which is a function of the description set S. Fig. [TJ illustrates the problem 
setting for K = 3, and a specific decoding requirement for the decoders. 

Formally, we define the notion of ordering level to connect the decoding requirement of the decoders to 
their available description subsets as follows. 

Definition 1: A valid ordering level (or simply ordering) on the non-empty subsets^ of {Ti, T 2 ■ ■ ■ , T K } 
is a one-to-one mapping jSf : V{{T 1 , T 2 . . . , IV}) \ — ► {1, . . . , 2 K — 1} satisfying 

(i) Jzf({r x }) < ^({r 2 }) < ■ ■ • < J*?({r*}), 

(ii) S C T implies jSf(S) < JSf(T), 

where V(M) is the power set of M. 

The ordering level will be used to determine the decoding requirements of the decoders, e.g., a decoder 
with a set of descriptions S needs to decode the first jSf (<S) source streams. Condition (i) is given to avoid 
permuted repetition of the levels, where without loss of generality, we assume an initial ordering on the 
single description decoders. Condition (ii) is a natural fact that if S is a subset of T, then the corresponding 
decoder can not do better than what decoder T can. We may simplify the notation occasionally, by omitting 

3 For the rest of this paper, by subset we always mean a non-empty subset although it is not precisely mentioned. 
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the braces, e.g., Jz?(Ti,T 2 ) = Jz? ({Ti, T 2 }). The inverse mapping Jzf _1 (A;) is well defined, which is the 
subset of descriptions whose ordering level is k. 

An [n; Jzf ; Mt,i e {1,2,..., if}) MLD-code is defined by a set of encoding functions 

F, : Vr x V 2 ra x ■ ■ • x V 2 \_ x — ► {1,2,..., Mi}, i & {1,2, ... , K}, (2) 
and decoding functions 

G s : \{{l,...,M J }^V^xV^x---xV n ^ s) , S C {T 1 , . . .,T K }, (3) 

where Y[ denotes a set product. We define 

^ (5) (5)^G 5 (F j r);j:r j 6 5) (4) 

and V^^S) is the corresponding part of U^^(S), for i < ££{S). 

A rate tuple = (R 1 , R 2 , . . . , Rr) is called admissible for a prescribed ordering ££ , if for any e > 
and sufficiently large n, there exist an (n; Jzf ; Mi, i £ {1,2,..., K}) MLD-code such that 

-logM, <R t + e, « £ {1,2,..., K}, (5) 

n 

and 

Pr(V™(<S) ^ V,n < e MS C {r 1; . . . , r^}, and Mi < Jgf (5). (6) 

The main goal in the (lossless) multilevel diversity coding problem is to characterize 7^mld 5 the set of all 
achievable rate tuples (R4, i G {1,2,..., K}) in terms of the entropy of the source sequences and the given 
ordering level. We denote such rate region by TZmld f° r a specific ordering. 

In this paper we consider this problem for three descriptions (K = 3) and give a complete characterization 
of the rate region. It is straightforward to show that there are eight possible orderings for {Ti, T 2 , r 3 }, which 
are shown in Table HI We may further divide each ordering into sub-regimes to simplify the problem for 
each case. The results of this work are general and hold for all possible orderings. However, in order to 
illustrate the result, we may specialize some of the arguments/theorems to the ordering level Jzfi defined as 

s%(r 1 ) = i, jsfi(r 2 ) = 2, j£?i(r 3 ) = 3, 
^ 1 (t 1 ,t 2 ) = a, if 1 (r 1 ,r 3 ) = 5, J2?i(r 2 ,r 3 ) = 6, ^(r^ra) = 7. 
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Fig. 1. The 3-description asymmetric multilevel diversity coding problem for ordering level Jzfi. 
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Fig. 2. Levels assigned to the description subsets determines the recoverable source subsequences. The requirements corresponding to the 
ordering level 5£i are shown in this figure. 



The setting of the problem for the ordering level JSfi is shown in Fig. CD 

Fig. [2] shows the subset of source streams which should be recovered by each subset of descriptions in 
Jzfx setting. 



B. Asymmetric Gaussian Multiple-Description Coding 

Let {X(t)} t =i t 2,... be a sequence of independent and identically distributed zero mean and unit variance 
real-valued Gaussian source, i.e., X — R, with time index t. Moreover, the reconstruction alphabet is also 
assumed to be E. The vector X(1),X(2), . . . ,X(n) is denoted by X n . We use capital letters for random 
variables, and the corresponding lower-case letters for their realization. The quality of the reconstruction 
is measured by the quadratic distance between the original sequence x n and the reconstructed one x n . 
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Formally, we define the distortion as 

1 " 

d{x n ) x n ) = -^\x{k)-x{k)\ 2 ) (7) 
n k=i 

In a general multiple description setting, the encoders produces K descriptions, namely T 1: r 2 , . . . , V K 
based on the source sequence and sends them to the decoders through noiseless channels. Each decoder 
receives a non-empty subset of the descriptions, and has to reconstruct the source sequence x n which 
satisfies a certain level of fidelity. 

In a manner similar to the last subsection, we denote each decoder by the corresponding set of available 
descriptions. Each decoder S has a distortion constraint D s , and needs to reconstruct the source such that 
the corresponding expected distortion does not exceed this constraint. The main goal in this problem is to 
characterize the set of admissible rates of the descriptions in a way that such reconstructions are possible. 
We present a formal definition of the problem next. 

An (n; Mj, % e {1, . . . , K}; A s , S C {T 1 , . . . , T K }) MD-code is defined as a set of encoding functions 

Fi : X n — >■ {1,2,..., Mj}, i & {1,2,..., K}, (8) 
and 2^ — 1 decoding functions 

G s : J] {1,...,M,-} — 5C{r lr .,r4, (9) 

with 

A s = Ed(x n ,x%), 5c{r lr .,r4, (io) 

where 

X$ = G s (F j (X n ),j:r j eS). (11) 
Again, Yi denotes set product, and E is the expectation operator. 

A rate tuple R = (R±, i?2, • • • , Rk) is called D = (Ds; S C {Ti, . . . , T^}) -admissible if for every e > 
and sufficiently large n, there exists an (n; M i: % e {1, . . . , if}; A 5 , 5 C {ri, . . . , T K }) MD-code such that 

-log Mi < Ri + e, ie {!,..., K}, (12) 
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and 

A s <D s + e, <SC{rV..,IV}. (13) 

We denote by TZ M d(D) the set of all D-admissible rate tuples, which we seek to characterize. 

Let T and S be two description sets, satisfying T C S C {Ti, . . . ,Tk}- It is clear that the decoder 
with access to S can reconstruct the source sequence as well as the one with access to T does, even if 
Ds > D?. The following lemma shows that slightly modification of the distortion vector in order to satisfy 
such property does not change the admissible rate region. 

Lemma 1: For a given distortion vector D, define D as D = (D s ; S C {r 1; . . . , T K }), where 

Ds = min Dr- 

T-.TCS 

Then ^ MD (D) =n MD (D). 

Proof of Lemma [7J- It is clear that D s < D s for all S C {T\, . . . and therefore 7^. M d(D) ^ 

7?.md(D)- So, it remains to prove 7^md(D) C 7?.md(D)- Let R G 7^. M d(D) be an admissible rate tuple for 
D, and (n; As) be a code for a given e which achieves the distortion constraints D, with encoding 
functions {Fj} and decoding functions {Gs}- We can easily modify the decoding functions and obtain a 
code which satisfies D. By the definition of D, for all S we have Ds = D§, where 

S = arg min Dr- 

T-.TCS 

Define 

x2 = G s {F j {x»y,j:r j eS)±x2. 

Obviously, 

Ed(X n , X£) = Ed(X n , X|) < D$ + e = D s + e. 

Thus the similar code with the modified decoding functions satisfies the constraint tuple D, and therefore 
Rg^md(D). ■ 
Given this lemma, we can assume, without loss of generality, that Dr < Ds for all S C T. These 
distortion constraints then induce an ordering on the decoders, or equivalently on their associated subset of 
descriptions. 
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(%£>rj 

(^rir 2 > A^rJ 
(^rirg'-^rirg) 

(^Firarg'-^rirara) 



In this work, again we focus on the three description (K = 3) problem, and present the results in general 
form, i.e., regardless the exact ordering. Occasionally we shall provide the proof details only for the specific 
sorted distortion constraints 

D Tl > D r2 > D r , s > D FlT2 > D TlT3 > D T2 r 3 > £> ri r 2 r 3 , 
which induces the ordering 

j*?(r\) < jsf(r 2 ) < jgf (r 3 ) < ^(r^) < ^(r^) < ^(r 2 r 3 ) < if(r 1 r 2 r 3 ) 

on the subsets of descriptions, which is exactly the aforementioned ordering S£\. Fig. [3] shows the setting 
of this problem for the ordering J^. It is worth mentioning that the distortion constraints may also induce 
different ordering of subsets of the descriptions. All possible ordering functions are listed in Table [fl 

III. The Main Results 

In this section we present the main results of the paper. We state the theorems in a unified way which hold 
for all orderings, and also specialize it to the ordering ££\ to facilitate understanding and further discussion. 
We start with the admissible rate region of the A-MLD problem, 72-mld, and then give an approximate 
characterization of the rate region of the A-MD problem based on the coding scheme inspired by the 
A-MLD problem. 
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Fig. 3. The three description source coding problem with ordering level 5£\. 



A. The Admissible Rate Region of ^-Description Asymmetric Multilevel Diversity Coding 
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The following theorem characterizes the admissible rate region of the asymmetric multilevel diversity 
coding problem for an arbitrary ordering level. 

Theorem 1: Let V = (Vi, . . . ,V?) be a given sequence of sources with entropy sequence H = 
(H U ...,H 7 ) = (H(V 1 ),H(V 1 ,V 2 ),...,H(V 1 ,...,V 7 )). For a given ordering level Jz?, the rate region 
7^ LD (H) is the set of all non-negative triples (R u R 2 , R3) which satisfy 



Ri > Hse^), 



1 = 



1,2,3 



(PI) 



Ri + Rj > H min{Sf( r.^ T .^ + H&p.p.), i ^ j 
2Ri + Rj + R k > H min {2>(r i ),js>(T j )} + Hmm{jf(r t ),jf(r k )} 
+ H'inin{jSf(r i) r J -)^f(r i ,r fc )} + #2x^,1^), 



(P2) 



(P3) 



Ri + R2 + R3 > Hsf^) + -ffmin{^ , (ri,r 2 ),^(r 3 )} + #sf(ri,r 2 ,r 3 ), 
Ri + R2 + R3 > H^n) + 2^(r 2 ) + 2- ff min{-^(ri,r2),^(ri,r3),^(r 2 ,r 3 )} 
+ f>(ri,r2,r 3 )- 



(P4) 



(P5) 



In the following corollary, we specialize the bounds for the specific ordering J? 1 . 

Corollary 1: For the ordering level j£f l5 the admissible rate region of the three-description A-MLD 
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problem is given by the set of all rate triples R 2 , R3) which satisfy 

Ri > if(Vi), (Ql) 

R 2 >H(V 1 ) + H(V 2 ), (Q2) 

R3 > Hfy^ + H(V 2 ) + H(V 3 ), (Q3) 

R ± + R 2 > 2H(V 1 ) + H(V 2 ) + H(V 3 ) + H(V 4 ), (Q4) 

R l + R 3 > 2H(V l ) + H(V 2 ) + H(V 3 ) + if (V 4 ) + H(V 5 ), (Q5) 

R 2 + R 3 > 2H(V 1 ) + 2H(V 2 ) + H(V 3 ) + H(V A ) + H(V 5 ) + H(V 6 ), (Q6) 

2R 1 + R 2 + R 3 > AH{V X ) + 2H(V 2 ) + 2H(V 3 ) + 2H(V 4 ) + H(V 5 ) + H(V 6 ) + H(V 7 ), (Q7) 

R 1 + 2R 2 + R 3 > 4if (K) + 3H(V 2 ) + 2H(V 3 ) + 2H(V 4 ) + H(V 5 ) + H{V 6 ) + H(V 7 ), (Q8) 

R x + R 2 + 2R 3 > AH{V X ) + 3if (V2) + 2H(V 3 ) + 2H(V 4 ) + 2H(V b ) + H(V 6 ) + H(V 7 ), (Q9) 

R 1 + R 2 + R 3 > 3ff (14) + 2H(V 2 ) + 2H(V 3 ) + H{V A ) + H(V 5 ) + H(V 6 ) + H(V 7 ), (Q10) 

i2i + i? 2 + R 3 > 3if(K) + 2ff(F 2 ) + ^#(^3) + ^(^4) + #(^5) + # (V 6 ) + H(V 7 ). (Qll) 



5. Approximate Rate Region Characterization of Gaussian Asymmetric ^-Description Coding 



In the following theorems, we establish outer and inner bounds for the rate region of the Gaussian 
asymmetric multiple descriptions coding. 



Theorem 2: For a given distortion vector D = (D Tl , . . . , -Drir 2 r 3 ), denote by 7£ MD (D) the set of all 
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rate triples (Ri, R 2 , R3) satisfying 

^>^lo g7 j-, * = 1,2,3 (0-1) 

Z Ut 

Ri + R 3 > mm g log \ log + I log -L- - 1, i^j (0-2) 

2^ + J2, + R k > min Q log 1 log JLj + min Q log ± log -L 

+ min (- log— — , - log— —J + ^log— 3, i^j^k (0-3) 

Ri + R 2 + R 3 >l log + min ( - log j^—, ~ log — - 
^ -^ri \^ -^rir 2 ^ u v :i 

+ ^log— 2, (0-4) 

fl. + + R 3 > \ log j^- + min (i log -L-, i log -L-, i log _L- 

119 

+ 2 bg D 2' ( °- 5) 



Then any admissible rate triple belongs to 7£ MD (D), i.e., 7£md(D) C 7£ md (D). 



The bound stated in this theorem is a consequence of a more general parametric outer bound 'B^ AD (D, d), 
defined in Theorem @J However, the current form is more convenient for comparison between the inner and 
outer bounds. This region is given in the following corollary for the specific ordering 
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Corollary 2: Any admissible rate triple for a three-description A-MD with Jzfi ordering satisfies 

Ri>hog^-, (O'-l) 

R2>hog-±-, (0'-2) 

R 3 >^ log (C-3) 

Ri + R2>hog—^- 1, (O'-A) 

Ri + R 3 >llog—-^ 1, (0>-5) 

i?2 + i?3>^log— 1, (C-6) 

2R l + R 2 + R 3 >hog 1 3, (O'-l) 

fl 1 + 2fi 2 + fl 3 >llog 1 -3, (O'-S) 

* -LSI l-^L 2 t li 2 i li 2i 3 

fl 1 + fi 2 + 2fl 3 >ilog 1 -3, (0'-9) 

* -^1 l 2 1 ll 3 1 ll 2l 3 

^l+^2 + ^3>^l0g 1 ~ (O'-IO) 

R 1 + R 2 + R 3 >\\og 1 2. (C-ll) 

4 JJ ri JJ r2 JJ ri r 2 JJ rir2r3 



Theorem [3] gives an inner bound for the admissible rate region of the three-description A-MD problem. 



Theorem 3: For a given distortion vector D = (D ri , . . . ,D rir2 r 3 ), let 7Z M d(D) be the set of all rate 
triples (Rx, R 2 , R 3 ) satisfying 
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Ri> hog-±-, i = 1,2,3 (1-1) 

z IJr 

^ + > min Q lo § ^ \ lo § ^r) + ^ log ^ j (x-2) 

2 Rl + + > min (1 log 1 log JL) + min Q log ± log JL 

+ min ( ilog— — ,^log — — J + ^ log — , i^j^k (1-3) 

\Z U v%Vj I L> v%Vk ) I L) V l Y ] Y h 

11 /l 1 1 1 \ 1 1 

R 1 + R 2 + R 3 > - log — - + min - log , - log — - + - log , (1-4) 

1 1 (\ 11,11,1 

R\ + R2 + R3 > - log 2 h mm ( - log — , - log — , - log 



4 °D^Dr a \2 °V 2 2 ° AW 2 A 2 r 3 

+ ^log— — . (1-5) 



Then any rate triple R e TZmd is achievable, i.e, TZmd Q ^md- 



The following corollary specifies the above theorem for the ordering level 



Corollary 3: If the distortion constraints satisfy the ordering level Jzfi, i.e., 

D Tl > A 2 > D Ts > D VlV2 > D TlF3 > D r2 r 3 > £> ri r 2 r 3 , 
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then any rate triple i? 2 , -R3) satisfying 



Ri 


> 


2 


1 

' A x ' 


(I'- 


-i) 


R2 


> 


2 


1 

'A 2 ' 
1 

'A 3 ' 
1 


(T'- 


-2) 


R 3 


> 


cr- 


-3) 


R\ + R2 


> 


2 


(!'■ 


-4) 


Ri + R 3 


> 


- loe 

2 e 

l 


1 

i^n -^rir 3 
1 

1 n n ' 

-kr 2 -kT 2 r 3 

1 

1 r>2 n n 

-^i-^rira-^Tirara 


(T- 


-5) 


R2 + R3 


> 


(J' 


-6) 


2Ri + i?2 + R3 


> 


z 


(X'- 


-7) 


R\ + IR2 + -R3 


> 


— loe 

2 e 

- loe 

2 e 


1 

' A x D T2 D Tl r 2 D ri r 2 r 3 ' 


(X'- 


-8) 


i?l + i?2 + 2i?3 


> 


1 

' Ai-Dr 3 Air 2 r 3 ' 


cr- 


-9) 


i?l + i?2 + -R3 


> 


- loe 

2 e 


1 

' A3.A3A3.r2r3' 


(X'- 


10) 


i?l + i?2 + -R3 


> 


4 


1 

' d t x A 2 Air 2 - D rir 2 r 3 ' 


cr- 


11) 



is achievable. 

Summarizing the results of Theorem |2] and Theorem [3] gives the following corollary. 
Corollary 4: 

7WD) Q ^md(D) C ^md(D). (14) 

The result of this corollary is that the multiple description admissible rate region is bounded between 
two sets of hyperplanes, which are pair-wise parallel. For each pair of parallel planes, we can compute 
the distance between them. Denote by Sr x>VtZ ) the Euclidean distance between two parallel planes which 
are orthogonal to the vector (x, y, z). Then for the distortion constraints corresponding to ordering «5f l5 we 
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have 

(15) 

0.7071, (16) 
1.2247, (17) 
= 1.2990, (18) 

where the denominators are the normalizing factors, corresponding to the length of the vector (x, y, z). This 
shows that the inner and outer bounds provide an approximate characterization for the admissible rate region, 
for which the Euclidean distance between the bounds in less than 1.3 in the worst case. Fig. 0] shows a 
typical pair of inner and outer bounds for «Sfi ordering and the case Dy 2 Dy 1 t ! , < -Dr 3 — Dy 2 Dy 1 t 2 i which is 
the lossy counterpart of the lossless A-MLD problem with /i 4 < h 3 < /i 4 + /i 5 , discussed in Subsection IIV-B1 
under regime II (see also Fig. [7]). 
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In this section we first prove the converse part of Theorem Q] for all orderings, and then the achievability 
part for ordering Jzfi. Similar techniques can be used straightforwardly to prove the achievability for all the 
other orderings, and therefore complete the proof of Theorem [T] 

A. The Converse Proof 

In this subsection we show that any admissible rate triple satisfies (1P1I) - (|P5I) . The following important 
lemma, which simplifies the proof of the theorem, relates the entropy of the original source to the 
reconstructed one. 

Lemma 2: Let S C {Ti, L 2 , T 3 } be a subset of descriptions available at a decoder, and i < j < Jzf (5). 
Then 

H{S\U? ) > H(S\U r /) + n(Hi -Hi- S n ) (19) 

where 5 n — > as n increases. 

Proof: Note that i < j < Jt?(S). Therefore, the decoding requirement for the decoder with access to 
S implies that the reconstructed sequence tjJ{S) equals to U™ with high probability. Then 

H(S\Un = H(S,U?(S)\Un 

= H(S, Uf, U?{S)\U?) - H{U?\S, U?(S), 
> H(S, U™\U?) - H(U?\U?(S)) 

( = } H{S\U^) + H{U™\U?) - H(U?\U?(S)), (20) 

where (a) holds since UJ{S) is function of S, for j < Jzf(5), and (b) is due to the fact that Z7" is a 
subsequence of [/" for j > i. The underlying distribution of and U™ implies Hill^U™) = n(Hj — Hi). 
The last term in (T20I) can be upper bounded using the Fano's inequality [12] as 

H(U?\U?(S)) < h B (P e ) + P e log(|W;| - 1) < 1 +ncP e (21) 

where P e = Pt(U?(S) ^ £/") < e, h B (p) defined as 

Mp) = -plog 2 (p) - (1 -p) log 2 (l - p) 
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is the binary entropy function, and c = log \Uj \ is a constant. The proof is complete by setting 5 n = ^ + cP e . 



The converse proof of TheoremU} Let (Ri, R2, R3) be any admissible rate triple, and Ti be a single 
description with ordering level ^f(Fj). Recall Uq = 0, and note that Ug, T s(Ti) is a function of IV Thus 

n(R t + e)> HIT,) = H(T t \U r l ) > H(T t \U^ {rt) ) + n{H y[Ti) - 5 n ) > n{H y[Ti) - 8 n ). (22) 

This proves (IP1I) . Note that here and in the rest of this proof all the inequalities labeled by (*) are due to 
Lemma |2l 



Toward proving (|P2|) . we can write 

n(R l + Rj + 2s) > H(Ti) + H(Tj) 

> HiUU^) + n(H^ Ti) - Sn) + H{Y 3 \U^ {V]) ) + n(H^ Tj) - 5 n ) 

> n{Hjz( Ti) + Hjz( Tj ) - 28 n ) + H^T^U^^^.^^.^) + H^T^U^^p.^p.^) 

W 

> n(Hsf(Ti) + H&pj) - 25 n ) + n(H^^ r . jr .) - i/max{^(r i ),^(r J )} - 3 n ) 
+ H(Ti, r^fT^r.^.)) 

> n [-Hmin{jsf(r i ),jSf(rj)} + ^(r^) - 3<5„] . (23) 



For proving (|P3I) we can start with 

n(2Ri + Rj+Rk + 4e) > 2#(r i ) + H(Tj) + H(T h 



> [# (I^C/^) + nHxw - n5 n + H^U^) + nH^ Fj) - n5 n ] 
+ [H{Ti\U\ Vi) ) + nH^ {Vi) - n8 n + H(T k \U^ {Tk) ) + nH^ Tk) - n5 n ] 

> n{2Hx {Ti) + Hx {Vj) + H^ {rk) - A5 n ) + H(T h r^xmr^r,)}) 

+ H(Ti, ^k\Vmax.{se(ri),se(r],)}) 
(*) 

> n{2H^ {Tl) + tf^(r-) + #^(r fe ) - 45„) 

+ n{Hst(r uVj ) - ^max{^f(ri),^f(rj)} - &n) + H{T h V^U^.^^) 
+ n{H<z>( T . jTh) - H msx {se^ i ) r se{r h )} - K) + H(T U r fc |Z7^ (r . rfc) ) 

> n(i/ min {jsf(r i ) ) jsf(rj)} + #min{i?(r\),.5?(r fe )} + •Hjsf(r i ,rj) + •HjSf(r i ,r fc ) - 65„) 

(*) 

+ n(-Hjs?(r ij r i ,r fc ) - #mi«{j?(r i j' i )^(r i ,r Jk )} - *n) 
+-H m in{^f(r i ,r J ),jf(r i ,r fe )} + -£^(r\,r,,r fe ) - 7<5„] . 



Toward proving (IP4I) we can write 
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n(i?i + R2 + R3 + 3e) > F(ro + #(r 2 ) + #(r 2 



(*) 

+ FtTiif/]^)) + #(r 2 |c/|> (r2) ) + ^(r 3 |f/™ in{if(ri)r2)i ^ (r3)} ) 

> n(Hy( Tl ) + H£>(r 2 ) + if m jR{jSf(r ll r2),-S?(r 3 )} - 35„) 

+ ^(ri, r 2 |[/^ (r2) ) + -^(r3|tCin{^(ri,r 2 ),^(r3)}) 
(*) 

> n{H&(r x ) + i?sf(r 2 ) + ffmm{y(r 1 ,r 2 ),if(r 3 )} - 3£ n ) 

+ -H"(ri, r 2 |?7mm{^'(r 1 ,r 2 ),if(r3)}) + 7l (-ffmin{^f(r lj r 2 ) ) jSf(r 3 )} _ #js?(t 2 ) - ^ 
+ -^(r3|tCin{^f(r 1 ,r 2 ),if(r 3 )}) 

,r 2 ),j^(r 3 )} — 4<5 n ) 



+ J f/(r 1 ,r 2 ,r 3 |c/ ] 



min{jsf(ri,r2),^f(r 3 )}/ 



(*) 

> n{Hg( Vl } + 2if min {^( riir2 ) i ^ (r3 )} - 45„) 

+ n (H^(r 1 ,r 2 ,r 3 ) - #nun{j£f(ri,r 2 ),if(r 3 )} — ^n) 

> n [Hy {Fl ) + -ff m in{if(r 1 ,r 2 ),if(r 3 )} + filsf(r 1 ,r ai r 3 ) - 55 n ] . (25) 



We need to consider two different cases in order to obtain the other sum-rate bound in iP5h First consider 
the case 3?(T 3 ) > ^(T u T 2 ). Note that this implies min{Jf(r 1 , T 2 ),&(T U r 3 ), jgf (r 2 , r 3 )} = &(T U Y 2 ). 
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We have 



n(R 1 +R 2 + R 3 + 3e) > H^) + H(T 2 ) + H(T 3 ) 

> n^cro + H*<r 2 ) + ^(r 3 ) - 35 n ) + H^U^) + H{T 2 \U^ (T2) ) + H(T 3 \U^ rs) ) 
= n{H^ Tl) + + H^ (r3) - 35 n ) + ^(r^W + # (r 2 |[/^ (r2) )] 

+ ^[^(rxl^)) + H{T 3 \U^ { t z) )] + \[H{T 2 \U^ {T2) ) + H{T 3 \U^ z) )] 

> n(H^(n) + Hjf(r 2 ) + H&(r 3 ) - 35 n ) 

+ ±[H(T l7 T 2 \U^ T2) ) +H(T 1 ,r 3 \U^ {T3) ) + H(r 2 ,r 3 \U^ {T3) )\ (26) 

> n(ifsf( ri ) + #j?(r 2 ) + #Sf(r 3 ) - 3d n ) 

+ i [ff (rx, r 2 |C/l (ri)r2) ) + n(^ (ri ,r 2) - H^ a ) ~ S n )} 

+ \ [H(r u r 3 |c/l (r3) ) + # (r 2 , r 3 \u^ T3) )} 

(°) 1 1 7 

> n(Hy {Tl ) + -i?i?(r 2 ) + ^#s?(ri,r 2 ) + #sf(r 3 ) - 

+ 1 [^(rx, r 2 |^ (r3) ) + #(r\, r 3 |^ (r3) ) + #(r 2 , r 3 |c/^ (r3) )] 
( fc ) 1 1 7 

> n(H<£ {Vl) + -i?if(r 2 ) + ^-^(r^ra) + #Sf(r 3 ) - r^O + #( r i> r 2, r 3|^(r 3 )) 
(*) .1 1 7 

> n(Hj?( Tl) + -H<?(r 2 ) + -Hsf(r u r 2 ) + #s?(r 3 ) - + ™(#s?(ri,r 2 ,r 3 ) - #Sf(r 3 ) - <^n) 



= n 



2" 

1 1 9 

#s?(ri) + 2^(r 2 ) + 2^( r i. r 2) + ^(ri,r 2 ,r 3 ) - ^ 



(27) 



where in (a) we have used H(Ti,T 2 \U2 f ^ Ti > H(Ti,T 2 \U2f^ r ^), implied by the assumption Jz?(r 3 ) > 
J2f(ri,r 2 ), and (6) is due to the conditional version of Han's inequality [12, page 491]. For the second 
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case, i.e., Sf(T 3 ) < £f(T ll T 2 ), we have from (l26l) . 



n(R 1 +R 2 + R 3 + 3e) > n{H^ [Tl) + #^ ( r 2 ) + iZ>(r 3 ) - 3<5 n ) 

+ ~ [F(r\, r 2 |^ (ra) ) + F(r\, r 3 |^ (r3) ) + F(r 2 , r 3 |^ (r . 3) )] 



w 1 

> n(.f/jf(r 1 ) + #£f(r 2 ) + #s?(r 3 ) - 3<5 n ) + - 



iy(ri,r2|tCin{jf(ri,r 2 ),^(r 1) r3),^f(r 2 ,r 3 )}; 



+ ^(3-ff m m{^(r 1 ,r 2 ),^(r 1 ,r 3 ),^(r2 i r3)} ~ #s?(r 2 ) - 2 ^(r 3 ) - 35„ 



( c ) 1 3 



13 9 

> n(Hj^ iTl) + -H#(r a ) + -F m i n {jf(r 1) r 2 ),^(ri,r 3 ),jSf(r 2 ,r 3 )} - ^n) 

+ n(i^( ri ,r 2 ,r 3 ) ~~ ^mia{^ , (r 1 ,ra)^f(ri,r3),-Sf(r 2 ,r3)} - <*n) 



n 



^ jSf(ro + r-HjSf(r 2 ) + ^-Hmm{jf(ri ) r 2 ),^'(ri,r 3 ),^'(r 2 ,r 3 )} + •Hjsf(ri,r2,r 3 ) _ 



(28) 



Again we have used the conditional Han's inequality in (c). Putting (1271 ) and ([281 ) together, we obtain the 
bound (fP5i ■ 



B. Achievability 

In the following we will show that the inequalities (1P1I) - (1P5I) provide a complete characterization of 
the achievable rate region of the A-MLD problem. However, each individual case given in Table H needs 
to be considered separately, due to the specific strategy used in the coding scheme. For conciseness, we 
only present the analysis for the ordering level Jdi, and provide the details of the achievability scheme 



for this specific ordering. More precisely, we show that any rate triple (R\, R 2} R 3 ) satisfying ( |Ql| H lQTT| ) 
is achievable, i.e., there exist encoding and decoding functions with the desired rates which are able to 
reconstruct the required subset of the sources from the corresponding descriptions. This implies 7£j^ D (H) 
is achievable, and completes the proof of the theorem for the ordering ££\. Similar proof for other orderings 
can be straightforwardly completed by applying almost identical techniques. Different cases that needed to 
be considered are listed in Table HI 

Note that the TZmld ls a polytopes specified by several hyperplanes in a three-dimensional space. 
Therefore, the region TZ^ld * s a convex polytopes, and it suffices to show the achievability only for the 



TABLE I 

The eight possible level orderings and the corresponding sub-regimes. 
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Ordering 


Regime 


if(r\) < if(r 2 ) < if (r 3 ) < if (r 12 ) < if(r 13 ) < if (r 23 ) < if (r 123 ) 


h 3 < hi 


hi < hz < hi + /15 


h 3 >h A + h 5 


jgf (ro < if (r 2 ) < jgf (r 3 ) < if(r 12 ) < i^(r 23 ) < if (r 13 ) < if (r 123 ) 


h 3 < hi 


hi < h 3 < hi + h$ 


h 3 >h A + h 5 


if (r x ) < if (r 2 ) < if (r 3 ) < if(r 13 ) < if (r 12 ) < i^(r 23 ) < if (r 123 ) 


h 3 < hi 


h 3 > hi 


if (r\) < if (r 2 ) < if (r 3 ) < if (r 13 ) < i^(r 23 ) < if (r 12 ) < if (r 123 ) 


h 3 < hi 


h 3 > hi 


if (r\) < if(r 2 ) < if (r 3 ) < i^(r 23 ) < if (r 12 ) < if (r 13 ) < if (r 123 ) 


h 3 < hi 


h 3 > hi 


if (r x ) < if (r 2 ) < if (r 3 ) < if(r 23 ) < if (r 13 ) < if (r 12 ) < if (r 123 ) 


h 3 < hi 


h 3 > hi 


if (r x ) < if (r 2 ) < if (r 12 ) < if (r 3 ) < if (r 13 ) < if (r 23 ) < if (r 123 ) 


h 3 < h 5 


h 3 > h 5 


if (r\) < if (r 2 ) < if (r 12 ) < if (r 3 ) < i^(r 23 ) < if (r 13 ) < if (r 123 ) 


h 3 < h 5 


h 3 > h 5 



corner points [18]; that is because a simple time-sharing argument can be used to extend the achievability 
to any arbitrary point in the region TZmld- 

Depending on the relationship of h 3 , hi, and h 5 , some of the inequalities in ( |Ql[ )-( [QlT| ) may be dominated 
by the others. Note that (|Q10[) and <\Q1 1[) are of the form 



R x + R 2 + R3 > ZH(y x ) + 2H(V 2 ) + 2H{V 3 ) + H(V A ) + H{V 5 ) + H{V 6 ) + H{V 7 ), 
R, + R 2 + R 3 > 3H(V 1 ) + 2H(V 2 ) + ^H(V 3 ) + ^H(V A ) + H(V 5 ) + H(V 6 ) + H(V 7 ). 

It is clear either one of them would be redundant and implied by the other, depending on whether h 3 hi. 
Also if h 3 > hi + h 5 , inequalities ( |Q3[ ) and ( |Q10| ) imply 

i?i + # 2 + 2R 3 >H 1 + H 3 + H 7 + H 3 

>H 1 + H 3 + H 1 + H 2 + hi + h b 
= H 1 + H 2 + H 5 + H 7 , 



which is exactly the inequality given in <\Q9^ , i.e., this inequality is redundant in this regime. Thus, we 
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split the achievability proof into three regimes corresponding to the aforementioned conditions, since the 
proposed encoding schemes are slightly different for these regimes. We show the achievability of the corner 
points in each case. 

To simplify matters, we perform a lossless pre-coding, acting on all the seven source sequences V^'s as 

Ei : V™ — > {0, 1}* 

for i = I, ... ,7. This function maps the source sequence V™ to Vi = EiiV™), which can be used as a 
new binary source sequence of length £j. This can be done by using any lossless scheme, and achieves 
ii arbitrary close to nhi for large enough n. With the new source sequences we next perform further 
coding. 

Regime I: h 3 > h 4 + h 5 

As mentioned above, the inequalities \Q9^ and <\Ql 1[ ) are dominated by the others in this regime. Therefore 



we only need to consider the remaining nine hyperplanes. In the following we list the corner points of 
"T^mld in this regime. Each corner point with coordinates R 2 , R 3 ) is the intersection of (at least) three 
hyperplane, say (Qi), (Qj), and (Qk). Such point is denoted by (Qi,Qj,Qk) : (Ri, R 2 , R 3 ). In order to 
list all the corner points, we first find the intersection of any three hyperplanes, and then check whether 
the intersection point satisfies all the other inequalities. We next provide an encoding strategy to achieve 
the rates prescribed by the corner points of the polytope. 
. X x = \QI\QA\Q1\ : (H U H 4 ,H 7 ) 



This corner point is the intersection of the planes Q 1 , Q 4 , and Q 7 , and determines the individual rates 
of the descriptions as 

(Ri, R2, R3) = (Hi,H 4 ,H 7 ). 

The scheme for achieving this rate tuple is as follows. r x is exactly the pre-coded sequence of V™, 
i.e., V\. In order to construct T 2 it suffices to concatenate the codewords V\, V 2 , V%, and V4. Similarly, 
T 3 is the concatenation of all the seven codewords. That is, 



T 1 :V 1 , T 2 : V u V 2 , V 3 , V A , T 3 : V u V 2 , V 3 , V 4 , V 5 , V 6 , V 7 . 



It is easy to check that the description rates are the same as the rate triple of the corner point, and all 
the decoding requirements at the seven decoders are satisfied. 

We will only determine the rate triples and illustrate the descriptions construction for the remaining 



corner points. 
. X 2 = \Q\\Q5\Q1 ) 
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(Hx,H 7 -h 5 ,H 5 ) 



r 2 : v h v 2 , v 3 , v 4 , v 6 , v 7 , r 3 : v x , v 2 , v 3 , v 4 , v 5 . 



X 3 = \Q2\QA\Q%\ : (H x + h 3 + h 4 ,H 2 ,H 7 ) 



Ti : V x , V 3 , V 4 , T 2 : V h V 2 , T 3 : Vx, V 2 , V 3 , V 4 , V 5 , V 6 , V 7 . 



x 4 = < ig2|g6|g8| ) : {h x + h + h 4 + h 7 , h 2 , h 6 



Tx : Vx, V 3 , V 4 , V 7 , T 2 : V u V 2 , T 3 : Vx, V 2 , V 3 , V 4 , V 5 , V 6 . 



X 5 = 4Q3|Q5|Q10| ) : (Hx + h 4 + h 5 , H 3 + h 6 + h 7 , H 3 ) 

The encoding schemes for the previous corner points only involve concatenation of different codewords. 
However, concatenation is not optimal to achieve the rate triple induced by the point X 5 , and we need to 
jointly encode the sources to construct the descriptions. This can be done using a modulo-2 summation 
of (parts of) the codewords of the same size. 

The description Ti is simply constructed by concatenating Vx, V 4 , and V5. Similarly, Y 3 is obtained by 
putting Vx, V 2 , and V 3 together. The second description, T 2 , should be able to help Vx to reconstruct V3 
at the decoder with access to {r 1; T 2 }, and help T 3 to reconstruct (V 4 , V 5 ) at decoder {r 2 , r 3 }, where 
V 3 is already provided as a part of T 3 . We can use this fact to construct T 2 as follows. Partitionj the bit 
stream V 3 into V^i and V 3>2 of lengths £ 3 — (£ 4 + £ 5 ) and £ 4 + £ 5 , respectively. Compute the modulo-2 
summation (binary xor) of the bitstreams V 3y2 and (V 4 ,V 5 ). The description T 2 is constructed by 
concatenating this new bit stream with Vx, V 2 , V 3tl , V e , and V 7 . 
The partitioning and encodings are illustrated in Fig. |5] 



Ti : V, V 4 , V 5 , T 2 : Vx, V 2 , V 3jl , V 3 , 2 © (V 4 , V 5 ), V 6 , V 7 , T 3 : Vx, V 2 , V 3 



X 6 = < |g>3|g>6|g>10| > : {Hx + h 3 + h 7 , H 2 + h 4 + h 5 + h 6 , H 3 ) 

Partition V 3 into V^i and V 3j2 of lengths £ 3 — (£ 4 + £ 5 ) and £ 4 + £ 5 , respectively. 



Ti : Vx, V 3tl , V 3 , 2 © (V 4 , V s ), V 7 T 2 : V x , V 2 , V 4 , V 5 , V 6 , T 3 : V u V 2 , V 3 . 

4 Since we are in regime I, we have ^,3 > hi + h§ and hence, £3 > £4 + £5. 

5 Note that for this corner point, a part of the description F2 is given by ^3,2 ® (V4, Vs), which linearly combines independent (compressed) 
source sequences, just as the network coding idea in the familiar Butterfly network [13]. 
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Fig. 5. Linear encoding for the corner-point X$ 



x 7 = < ig4|g7|gio| > : (Hx + K, h 3 , H 3 + h 5 + h 6 + h 7 ) 

Partition V 3 into V 3 x and V 32 of lengths £ 3 — £4 and £4, respectively. 



l\ : Vx, V 4 , T 2 : V x , V 2 , V 3tl , ^3,2 © V A , T 3 : V, V 2 , V 3 , V 5 , V s , V 7 . 



X 8 = qg4\\Q8\ [QTOf : {Hi + h 3 , H 2 + h 4 , H 3 + h 5 + h 6 + h 7 ) 
Partition V 3 into V^i and V 3j2 of lengths £ 3 — £4 and £4, respectively. 



Ti : V 1 , V 3>1 , ^3,2 © V 4 , T 2 : V u V 2 , V A , T 3 : V 1 , V 2 , V 3 , V 5 , V 6 , V 7 . 



X 9 = ^}5\\g7\ g£[0} : (Hx + h 4 , H 3 + h 6 + h 7 , H 3 + h 5 ) 

Partition V 3 into V 3; x and V 3}2 of lengths £ 3 — £4 and £4, respectively. 

Ti : Vx, V A , T 2 : Vx, V 2 , Vx, V 2 © V 4 , V, V 7 , T 3 : V x , V 2 , V 3 , %. 



Xxo = S gS\ \QW$ : (Hx + h 3 + h 7 , H 2 + h A , H 3 + h 5 + h 6 ) 
Partition V 3 into V 31 and V 32 of lengths £ 3 — £4 and £4, respectively. 



Ti : Vx, V 3 ,x, V 3t2 © V A , V 7 , T 2 : V u V 2 , V A , T 3 : V x , V 2 , V 3 , V 5 , V 6 . 

The associated rate region is shown in Fig. [6l 
Regime II: h A < h 3 < h 4 + h 5 

In this regime, <\Ql 1[ ) is dominated by ( |Q10| ). Therefore, we only have to consider ten hyperplanes. The 
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rates and encoding scheme for the corner points Y 1 = jQl\Q4\QT\ , Y 2 = ]Ql\Q5\QT\ , Y 3 = t \Q2\Q4\Qfy , 
Y A = \Q2\Q6\Q%\ , Y 7 = ( |Q4|Q7|Q10^ Y 8 = (\Q4\QS\Q101 Y 9 = 4Q5|Q7|Q10| ) and Y 10 = 4Q6|Q8|Q10 > 

are exactly the same as that of X\, X 2 , X 3 , X4, X 7 , X$, Xg, and X w , respectively. For the remaining 
corner points, we next provide the encoding schemes. 

. Y 5 = [Q5} [Q9} : (#1 + h 4 + h 5 , H 2 + h 4 + h 5 + h 6 + h 7 , H 3 ) 
Partition V 5 into Vs,! and V 5j2 of lengths £ 3 — £4 and £4 + £ 5 — £3, respectively. Also partition V 3 into 
V^i and V 3>2 , of sizes £3 — £4 and £4, respectively. 



Ti : V h V 4 , V 5 , T 2 : V u V 2 , V 3}2 © V4, V 3jl © V* u V 5>2 , V 6 , V 7 , T 3 : V h V 2 , V 3 . 



Y 6 = ^3} [Q6j [Q9]> : (#! + h 4 + h 5 + h 7 , H 2 + h4 + h 5 + h 6 , H 3 ) 

Partition V 5 into V^i and V 5j2 of lengths £ 3 — £4 and £4 + £ 5 — £ 3 , respectively. Also partition V 3 into 
V 3 1 and V 32 , of sizes £ 3 — £4 and £4, respectively. 



r\ : v u V4, v s , v 7 , r 2 : v u v 2 , v 3 , 2 © v±, v 3>1 © v Sil , v 5>2 , v 6 , r 3 : v u v 2 , v 3 



Partition into V^i and t/ 5 2 of lengths £ 3 — £ 4 and £4 + £5 — £3, respectively. Also partition V3 into 
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V 3j i and V3 2, of sizes l 3 — £ 4 and £ 4 , respectively. 



r a : V 1} V 4 , V Sil , T 2 :V U V 2 , V 3 , 2 © V 4 , V 3A © V 5A , V s , V 7 , T 3 : V x , V 2 , V 3 , V h>2 . 



Y 12 = H [Q9J [QTOJ) : (Fx + h 3 + h 7 , H 3 + h 6 , H 2 + h 4 + h 5 ) 

Partition V 5 into V 5i i and V 5i2 of lengths £ 3 — £ 4 and £ 4 + £ 5 — £ 3 , respectively. Also partition V 3 into 
V31 and V 3>2 , of sizes £3 — £4 and £4, respectively. 



Ti : V u V A , V 5>1 , V r , T 2 :V U V 2 , V 3>2 © V 4 , V 3jl © V 5>1 , V 6 , T 3 : V u V 2 , V 3 , V 5>2 . 
Fig. U\ shows the rate region for this regime. 




Fig. 7. Rate region for Regime II of ordering level ££\\ hi < < hi + hs 



Regime III: h 3 < h 4 

It is clear that in this regime (jQTOj) is dominated by ( |Q1 1[ ), and thus ( |Q 10[ ) does not affect the rate 
region. The remaining ten inequalities characterize the region. The rates and coding schemes for the points 
Zi = dQl|Q4|Q7| ), Z 2 = \QI\Q5\Q1\ , Z 3 = \Q2\QA\Q%\ , and Z 4 = \Q2\Q6\Q%\ are exactly the same as 
that of Xi, X 2 , X 3 , and X 4 , respectively. The rate tuples and the corresponding descriptions for the other 
corner points are as follows. 

. Z 5 = ^3\^5\^9} :{H 1 + h 4 + h 5 ,H 2 + h 4 + h 5 + h 6 + h 7 , H 3 ) 



28 



Partition V4 into 14,i an d 14,2 of lengths £3 and £4 — £ 3 , respectively. 



ri : v u 14, v 5 , r 2 : Vi, V 2 , V 3 © V 4ih 14,2, 14, 14, v 7 , r 3 : Vi, 14, v 3 . 



Z 6 = ^3} [Q9]> : (#1 + fr 4 + h + h 7 , H 2 + h i + h 5 + h 6 , H 3 ) 
Partition V4 into V41 and 14, 2 of lengths £3 and £4 — £ 3 , respectively. 



r\ : 14, 14, 14, v 7 , r 2 -.v 1 , v 2 , v 3 © v 4>1 , v i;2 , v B , v 6 , r 3 : Vi, v 2 , v 3 



2 ' 



#2 + #2 + ^ + + ^6 + h 7 ) 



Partition 14 into V\\, 14,2, and 14,3 of lengths £ 3 , |(£ 4 — £ 3 ) and ~(£ 4 — £3), respectively. 



Ti : V 1} 1/4,1, 14,2 r 2 : V u V 2 , V 3 © 1/4,1, 14,2 © 14,3, T 3 : 14, l/ 2 , 14, 14,3, V s , V 6 , V 7 . 



Z 8 = S W\W\ EH} : (^1 + H ? + ^ + h * + h 7 , H 2 + M± + 

Partition 14 into 14,i, 14,2, and 14,3 of lengths £ 3 , |(£ 4 — £ 3 ) and \{£^ — £ 3 ), respectively. 



Ti : Vu 14,i, 14,2 T 2 :Vu V 2 , V 3 © 14,i, 14,2 © 14,3, V 6 , V 7 , T 3 : Vu V 2 , V 3 , 14, 3 , V 5 . 



Z 9 = ffl [Q8} [gTT]> : (#x + *a±k + /i 7 , If 2 + # 2 + ^ + /is + fo) 

Partition V4 into 14,i, 14,2, and V43 of lengths £ 3 , |(£ 4 — £ 3 ) and |(£ 4 — £3), respectively. 



Ti : Vu 14,i, 14,2, V 7 V 2 :Vu V 2 , V 3 © 14,i, V 4>2 © 14, 3 , T 3 : V u V 2 , V 3 , 14,3, 14, V 6 - 



^10 = B \Q8\ [§TT]> : (# x + + ^ ^ 2 + h^u + ^ ^ 2 + m±m + ^) 

Partition 14 into 14,1, 14,2, and 14,3 °f lengths £ 3 , \{t± — £ 3 ) and ^(£4 — £3), respectively. 



14 : Vu 14,i, V 4t2 , V 7 T 2 : 14, l/ 2 , V3 © 14,i, V 4>2 © 14, 3 , V 6 , T 3 : 14, V 2 , V 3 , 14, 3 , V 5 . 



This region and its corner points are shown in Fig. [8] 



The coding schemes proposed for these three cases give us the achievability proof of the theorem for 
the specific ordering J?4. As stated before, the coding scheme for other possible orderings listed in Table U 
are similar to that of the ordering Jzfx. There are three main ingredients used in all of them; (1) converting 
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the source sequences into bitstreams, (2) partitioning the bit streams into sequences of proper length, and 
(3) (if required) applying linear coding (binary xor) on them. This completes the proof of Theorem [TJ 

V. Asymmetric Multiple Description Coding 

In this section we prove Theorems [2] and [3l which together give an approximate characterization for the 
admissible rate region of the A-MD problem. 



A. An Outer Bound for the Rate Region of A-MD: Proof of Theorem\2\ 

In order to prove this theorem, we first show a parametric outer-bound for the A-MD rate region. Then 
we specialize the parameters to obtain the bound claimed in the theorem. 

We first need to define a set of auxiliary random variables in order to state and prove the parametric 
bound, which are some noisy versions of the source. The strategy of expanding the probability space by a 
single auxiliary variable was used to characterize the two descriptions Gaussian MD region [2], and later 
in [8] extended to include multiple auxiliary random variables with certain built-in Markov structure. We 
shall continue to use this extended strategy as used in [8]. 
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Let Ni ~ A/"(0, of), i — 1, . . . , 6, be mutually independent zero-mean Gaussian random variables with 
variance of. They are also assumed to be independent of X. A noisy version of the source, Yi, is defined 
as 

Y = X + Z u i = 1, . . . , 6 (29) 

where Zi = Y^j=i^j f° r J = 1, • • ■ ,6. Thus di = X]j=j a | would be the variance of the noises Zi, for 
i = 1, . . . , 6. We also define Y 7 = X and d 7 = for convenience. Note that incremental noises are added 
to X to build Yj's, and therefore they form a Markov chain as 

(r 1; r 2 , r 3 ) <-> x n <-> y 6 n <-> 17 <-> ■ • ■ <-> f™. (30) 



The following theorem provides a parametric outer-bound for the rate region of the A-MLD problem, 
depending on di variables, which are the noise variances defined above. Such bound holds for any choice 
of d\ > d 2 > ■ ■ ■ > d 6 > 0, and can be further optimized to obtain a good non-parametric outer-bound for 
the rate region. However, we simply derive the bound in Theorem |2] by setting the values of di's. 



Theorem 4: For a given distortion vector D = (D ri , . . . , D rir2 r 3 ) and a set of variables d 1 > d 2 > 
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> d 6 > d 7 = 0, denote by TZ^^D, d) the set of all rate triples (Ri, R 2 , -R 3 ) satisfying 
Rj >Jlog-i- j = 1,2,3 



+ log l + d *™ 1 + d ^ ] (^r J +4 1 ax mWj)} ) (po _ 2) 

2 + ^(ro £>r 3 + d^(v 3 ) (1 + dmax{i?(r;),.i?(r 3 )}) A^r, 

1 . / 1 + djs*(Ti) V 1 + ^(r 3 ) 1 + djs»(r fc ) 



2i?i + + i4 > - log 

2 V-Dr, + dj?(Ti)J D Tj + a^(r 3 ) £>r fc + os?(r fc ) 

1 1q (1 + ^(r i ,r J -))(-Dr i r i + cUax{^(r,),jy(r 3 )}) 

2 (1 + 4ax{y(r,),y(r 3 )})(£ ) r,r ) + G^(r\,r\,)) 
+ 1 j (1 + rfjsf(r i ,r fc ))(-Pr < r fc + rf ma x{jsf(r < ),.sf(r fc )}) 

2 (1 + rfmax{^(r l ),^(r fc )})(^ ) r l r fc + ^(r 15 r fc )) 

+ - log , (Dr ' r ' r * + d J^mM^lA i^j^k (VO -3) 
2 (1 + dmax{js»(r il r J -)^f(r i ,r fc )})-Pr i r J -r fc 

j R 1 + ^ + R 3 > I log 1 + d ^(Fi) 1 + ^(F 2 ) 1 + drmnm^^^iTs)} 

~ 2 D Tl + djffr^ Dr 2 + d^c(r 2 ) L>r 3 + rfmin{^ , (r 1 ,r 2 ),^(r 3 )} 
+ 1 j (1 + rfmin{.af(ri,r2),jsf(r3)})(-Prir 2 + ^(r 2 )) 

2 (1 + rfif(r 2 ))(-Drir 2 + d min{ ^(r lt r 2 )^ r3 )}) 
+ I i g - p r 1 r 2 r 3 + 4 1 in{if(r 1 ,r 2 ),if(r 3 )} (VO-4) 

2 (1 + c?mm{^f(ri,r 2 ),^(r 3 )})-Drir 2 r3 

^ + i? 2 + R 3 > l - log ■ 1 + 1 + ^ (F2) 1 + 



2 _Dn + rf^f(ri) -Dr 2 + ^s?(r 2 ) -Dr 3 + ^(r 3 ) 



where 



1 lo (1 + ^a)(-Pr 1 r 2 +dj?(r 2) ) 1 1q (1 + rf a )(-D ri r 3 + <kf(r 3 )) 
4 ° g (1 + ^ ( r 2) )( J Dr 1 r 2 + 4) 4 ° g (1 + d jS f(r s ))(^r 1 r3 + 4) 
+ I ^g ^ + ^)( D r 2 r 3 +d<?(r 3 )) + 1 A^rs, + rfg(r 3 ) (P0-5) 
4 (1 + rf^ ( r 3 ))(-Dr 2 r 3 + d Q ) 2 (1 + dsf(r 3 ))D ri r 2 r 3 ' 



^(r 3 ) if jsf(r 3 )>jsf(r 1 ,r 2 ), 

min{^(r 1 , r 2 ), (r\, r 3 ), jsf (r 2 , r 3 )} if ^f(r 3 ) < i?(r 1? r 2 ). 



Then any admissible rate triple belongs to ^^ D (D,d), z'.e., 1Z M d(D) C ^^ D (D,d), for all choices of 

di > ^2 > • • • > d 6 > d 7 = 0. 

The following two lemmas are extracted from [5], whose proofs can be found in Appendix A for 
completeness. They are useful to bound the mutual information between the noisy versions of the source 
and the descriptions. 



Lemma 3: For any set of descriptions S C {r!,r 2 ,r 3 }, and noisy version of the source Y,i 
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i — 1, 2, . . . , 7, we have 



^^TO- <31) 

Lemma 4: For any subset of the descriptions 5, and two noisy versions of the source Y; L and Yj with 
2 < j, we have 

We will use these results in several points in the proof of Theorem HI which are indicated by (f). Now, 
we are ready to prove the parametric outer-bound. 

Proof of Theorem 0' 

The single description levels inequalities are just straight forward result of Lemma [3l We have 

(t) n 1 

nR t > H(Ti) = H(Ti) - H(Ti\X n ) = I(T t ; X n ) > - log — (33) 

Z LJr 

1 i 



where we used Lemma [3] for Y 7 = X and the fact d 7 = in the last inequality. This proves <\VO— 11 ). 
The bound for the two description rates in ftPO— 2| ) follows from 



n(Ri + Rj + 2e) > H(Ti) + Hfa) 

>H{r i ) + H{r j )-H{r i ,r j \x n ) 

+ [I(TiTj;X n ) - /(IYr,-; ^axtyfr,).^^)})] 

(6) 

> /(r^; V5(r,)) + ^(r 3 -; Yjz>(Tj)) + [^0^1^-; X n ) - I(TiTj] ^ax{j^(r;),j&f(r\,)})] 

> ™ i g 1 + 1 + jggV) (1 + 0)(-Dr i r 3 - + ^maxmr,),^)}) (34) 
~ 2 -Dr, + rf^f(r<) D r . + dsf(r\,) (1 + d mSQ , { ^ {Ti) ^ {T])} )(D TiT] + 0) 

where the subtracted terms in (a) are positive due to the fact that T 1 and T 2 are functions of X n and 
non-negativity of mutual information, (b) is by the data processing inequality and the Markov chain in 
(l30l) . Finally, we have used Lemma [3] and Lemma |4] in (f). 
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The inequality §PO— 3| ) can be proved through the following chain of inequalities. 



n(2Ri + Rj + R k + As) > 2H{Ti) + fffo) + H(T k ) 
> 2H(T t ) + H(Tj) + H(T k ) - #(1^-1^ 

- # ( r\ | ^^{^(ri ),2'{T j )}) + -^"(rjl^max^cri),^^)}) _ H(r i rj\Y^ ax ^Q ? .^^Q ? ^y / 

- [HiFilY^ijzpiiJZirk)}) + -^(rfcl^max^cr,),^^)}) ~ #( r ir fc |y™ ax{J ^ (ri)i ^ (rfc)} 
HiTiTjlY^^^.j.^^^j,^) + H (TiT feKm ax {^f(r i) r 3 ),^f(r i) r fc )}) 

— # (r^r,- r fc I F" ax |^ (r . i r J ) ,^(ri ,r fc ) } ) 

+ -^( r i; ^max{if(r,),^(r fc )}) + ^0^5 ^max{^(r,),i?(r fc )}) 

+ [-f(Tjr fc ; ^max{^(r i ,r j ),^(r i ,r fe )}) ~ -^(^1^; ^m a x{j?(r\),js?(r fc )})] 

+ [^(^1^1^; I") - I(TiTjT k ; Y^^^.^.^^.^^)] (35) 

where in (a) we have used the fact that all the brackets are non-negative. Now, we will bound each term 
in (1351) individually. The single description terms can be bounded as 

m-, dyw^)}) > m Y% iVi) ) > \ bg 1+ ^ (r ° , (36) 

and similarly for j and A;. Also we can bound the differential terms as 



(6) 

> I(TiTj; Y£( r . r .)) - I{TiTj] ^m a x{j?(r\),^(r 3 )}) 

^ n b (1 + rfjf(r i r J -))(-Pr i r J - + <,x{y(r i ),y(r J )}) (3?) 

~~ 2 (1 + dmax{jSf(r i ) J jSf(r j )})(- D r i rj + ^(r^)) 



where (b) is due to the data processing inequality implied by the Markov chain 

(TiTj) <-> y^{j^(r i ,r J 0,.2 , (r i ,r fe )} ^ ^(r^) 
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implied by (|30l) . We also have 

I{TiTjT k ; X n ) — I(TiTjT k ; ^max{^(ri,r 3 ),^(ri,r fe )}) 

( 4J n (1 + 0)(L'r i r i r fc + ^max{^(r i ,r J ),^(r i ,r fc )}) ^ 
~2 (1 + d max {jsf(r i ,r J -),J2?(r i ,r fc )})(-Dr i r J -r fc + 0) 

By replacing (I36l)-(l38l) in (|35l) we get the desired inequality. 



In order to derive the sum-rate bound in (VO—A), we can write 



n(Ri + R 2 +R 3 + 3e) > H^) + H(T 2 ) + H(T 3 ) 

> HIT,) + H(T 2 ) + H(T 3 ) - H(T 1 T 2 T 3 \X n ) 

- [Hiv^Y^) + H(r 2 \Y^ F2) ) - i?(r x r 2 |yi (r2)/ 

- iy(r 1 r 2 Ki n {jf( rijr2 ) i jf( r3 )}) + ^ (r3|^ n {jf(r 1) r2),jsf(r 3 )}> 

- ^(rir 2 r 3 |F I ^ in | if(riir2) ^ (r3) j) 

> /(Ti; ^( ri )) + ^(r 2 ; ^5(r 2 )) + ( r 3; ^iSn{^(ri,ra),^f(r3)}) 
+ [/(rir 2 ; ^^(Ti.raX-SfCTg)}) ~ ^( r ir 2 ; ijf(r 2 ))] 

+ [/(rir 2 r 3 ; x n ) - /(rir 2 r 3 ; i^n^^^ra)^*^)}, 



(39) 



Again, applying Lemma [3] and Lemma |4] we can bound each term in (1391) , and obtain §VO—A\) 



It remains to show the bound in <\VO— 5| ). Recall the proof of (IP4I) . and consider two cases. If Jz?(r 3 ) > 
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«5f (fi, r 2 ), then Using the similar argument as in the proof of RPQ— 3D , we obtain 



n(i?i + ^ + ^3 + 3e) > #(ro + #(r 2 ) + #(r 3 ) - ff(rir 2 r 3 |x n ) 

- ~ [HiY^Y^) + ^(r 2 |F5 (r2) ) - H{T X T 2 \Y% {V2 
~ \ [H(Ti\n^)) + H(T 3 \Y- {T3) ) - ^(r^l^cr, 

- 1 (r 2 |Y£ (r3) ) + #(r 3 |r§ (r3) ) - # (r 2 r 3 |Yg (r , 3) ; 

- i [^(rxrai^j) + i^r^Y^) + h(v 2 v 3 \y^ V3) ) 

-2i/(r 1 r 2 r 3 |F5 (r3) )] 

> ^(ri; 5^(ri)) + -^( r 2; ^5(r 2 )) + -^( r 3; ^5(r 3 )) 

+ ^[/(r 1 r 2 ;i5 (ft) )-/(r 1 r 2 ;Y5 (ra) )] 
+ [/(r 1 r 2 r 3 ;^)-/(r 1 r 2 r 3; y^ (r3) )], 



(40) 



which gives us the desired inequality by using Lemma [3] and Lemma 0] to bound each individual term. 
Similarly, for the case where Jz?(T 3 ) < Jz?(Ti, T 2 ) we can write 



n(Ri + r 2 + r 3 + 3e) > ff(ro + #(r 2 ) + #(r 3 ) - # (r!r 2 r 3 |x n ) 

- \ [R{Y X \Y^ + H{T 2 \Y^ T2) ) - HiY^Y^] 

- \ [R{Y X \Y^ + H(r 3 \Y£ {rs) ) - HFJslYZw)] 

- \ ^(r 2 |^ (r3 )) + ^(Ts|i5(rs)) - ^(r 2 r 3 |yi (r3) )] 

- 1 [^(Txraiij) + #(1^^) + # (r 2 r 3 |r;) - ir{t x t 2 t 3 \y;)\ 

> I(Ti, Y&pi)) + ^(r 2 )) + -^( r 3; ^(r 3 )) 

+ i[/(r 1 r 2 ;y /3 ")-j(r 1 r 2; y5 (r2) )] 
+ i[/(r 1 r 3; y /3 «)-/(r 1 r 3 ;^ (r3) )] 
+ i[/(r 2 r 3; y;)-/(r 2 r 3 ;F5 (r3) )] 

+ [/(r x r 2 r 3 ; x n ) - /(iw^ yj)\. (41) 

where /3 = min{Jzf (r 1; T 2 ), Jzf (I^, T 3 ), .if (T 2 , T 3 )}. Now, we can use the above-mentioned lemmas again 
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to bound each individual term. It is clear that (|40l) and (|4TT) give <\VO— 5| ). ■ 
Remark 1: Note that there is an one-to-one correspondence between the converse proof of Theorem \T\ 
and that of Theorem HI In fact, here we use the description subsets and their capability of lossy recovering 
the noisy source layers, where they have been used to losslessly reconstruct the source levels in the A-MLD. 
Now we are ready to prove Theorem [2l which is a direct consequence of Theorem |4j 

Proof of Theorem [2]- We can choose arbitrary values of d/s, the variance of the additive noise in 
Theorem HI such that d\ > d 2 > • • • > d 6 > 0. One can optimize the bound in Theorem |4] with respect 
to the values of rfj's, and obtain a bound isolated from rfj's, by replacing them with the optimal choices. 
Such bound would be the best that can be found using this method. However instead of solving such a 
difficult optimization problem, we choose dj = D^-ir^, for i = 1, ... ,6. It is clear the d/s satisfy the 
desired non-increasing order due to the definition of the ordering level. We will later show that this choice 
gives a bound which is within constant bit gap from the inner bound in Theorem [3] 

The single description rate inequalities are exactly the same. The proof of the other inequalities is by 
straightforward evaluation of their counterparts in Theorem HI for di = D &-Ui), and applying simple bounds. 
We do not repeat the same arguments here, and only illustrate such derivation for one simple case. For the 
sum of two description rates, we can start with <\VO— 2| ) and use di = D^-ii^ to get 

Ri + Rj + 2e > - log ■ 



2 & D Ti + D Ft D T] + D T] (1 + mm(D T .,D T .))D riT . 



( b ) 1 1 + max(D ri , -Dr,) -Dr,r, + min(D ri , D r ] 
log 



2 ° AD Tl D T . D 



r r 



( c ) 1 min(D r , -Dr 
> lo S 



2 ° 4L» riJ D r .L>r ir . 

= - 1 + ^ lo g m n S +^ log 7^' (42) 

2 max(D ri ,D r;; ) 2 D r ,r 3 

where we have also used the fact d max (a,b) = min(d a , d 6 ) in (a) which is implied by decreasing ordering of 
(ii's, (b) is due to the fact that (1 + x)(l + y) = (1 + min(a;, y))(l + max(x, y)), and (c) holds since Dg's 
are non-negative. Similar simple manipulations give the other bounds in Theorem [2l 



B. A Simple Coding Scheme for ^-Description A-MD: Proof of Theorem \3\ 

Our approach to prove Theorem [3] is to present a simple scheme with description rates satisfying flZ— 1\ - 
flZ— 5 1 ) which guarantees the distortion constraints. This scheme is based on the successive refinability of 
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Gaussian sources [14], [15], as well as the asymmetric multilevel diversity coding result presented in the 
previous section. In the encoding scheme, we first produce seven successive refinement layers of the source, 
and then encode them losslessly. 

Successive refinement coding 

Consider the non-increasing sequence of distortion constraints D' = D^-i/ 2 ), ■ ■ • > Asf-Vf))- 

Produce seven layers of successive refinement (SR), *ff k for k — 1, 2, . . . , 7, such that one can reconstruct 
the source sequence within distortion constraint D^>-ir k \ using . . . , ^ k . Since the Gaussian source is 
successively refinable [14], it is clear that *& k can be encoded to a binary block of length arbitrary close to 

nh' k = nR{D<?-i {k) ) - nR^D^-i^^) (43) 

where R(D) = — | log.D is the unit variance Gaussian R-D function, and -D^-i(o) — 1- Note that by using 
fixed length code in SR coding, these blocks are block-wise independently and identically distributed. 

Multilevel diversity coding 

Now, it only remains to produce the descriptions such that the decoder at level J£(S) can losslessly recover 
the precoded bitstream SR layers . . . , \1> sf(s)i an d then reconstruct the Gaussian source sequence within 
distortion D s . Encoding and decoding of the precoded SR layers are exactly the A-MLD problem. We can 
simply use the rate region characterization of the A-MLD problem in Theorem Q] to find the achievable rate 
region of the proposed scheme for A-MD, where only substitution of V k = *ff k and U k = . . . , ^ k ) is 
needed. Therefore we have 

and 



11 
H k = J2 h i = o lo S Ti 

Replacing the values of H k s in Theorem [Q we obtain Theorem |3] 



(45) 



It is worth mentioning that although the successive refinement part of the scheme is well-known, producing 
the descriptions and their rate characterization is not an easy task without the A-MLD result. As an example, 
consider a system with ordering level Jzfi and assume -Dr 2 -Drir 3 < -Dp 3 < D^Dr^- An achievable rate 
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triple is 



{Ri, R 2 , Rs) - log - ^ ^ . .. 

2 l^n-^ra-^rjrarg ^ -^r 3 -^r 2 r 3 ^ -^2-^1^3 



1, ^r ir3 1, 
-log—— , -log' 



(46) 



which corresponds to the corner point Yi 2 in regime II of the A-MLD coding problem. The description 
encoding for this corner point is illustrated in Fig |9j Clearly, the coding scheme for this point matches that 
for Y 12 closely, and the SR encoded information in the 3-rd, 4-th and 5-th layers needs to be strategically 
re-processed using linear codes. Without the underlining A-MLD coding scheme, it appears difficult to 
devise this coding operation directly. 
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Fig. 9. Description encoding lossless reconstruction for a system with ordering level Jzfi and Dr 2 Dr 1 r 3 < Dr 3 — Dr 2 Dr 1 r 2 



VI. Conclusion 

We formulated the asymmetric multilevel diversity coding problem, an asymmetric counterpart for the 
symmetric version of the problem. A complete characterization of the admissible rate region is given for 
the three-description case. We partition the data and apply linear network coding (binary xor) on the 
partitioned subsequences, as a part of the proposed encoding scheme to achieve the upper bound. It turns 
out that using such a strategy of jointly encoding the independent data streams is crucial, and the outer bound 
is not achievable without using it, in contrast to the symmetric problem, in which the source-separation 
coding is known to be optimal. 

Using the intuition gained through A-MLD coding problem, we consider the Gaussian asymmetric three 
description problem. Inner and outer bounds for the admissible rate region are given, and the difference 
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between them are shown to be bounded by small universal constants. Though the general asymmetric 
Gaussian MD rate distortion region is hard to characterize, it is satisfying to see that a simple coding 
architecture is almost optimal. The A-MLD coding problem plays a key role in establishing these results, 
which further strengthens the connection between the MLD coding and the MD problem. Philosophically, 
this work is related to the approximation results obtained in the context of the interference and relay 
networks [19], [20], and further illustrates the effectiveness of the general approach of first treating the 
lossless (deterministic) coding problem, and then deriving approximate characterization for its lossy (noisy) 
counterpart. 



Appendix A 



Proof of Lemma El' 



I(S;Y?) = h(Y?)-h(y?\S) 

= h{Y?) - h(Y t n - X2\S) 
> h{Yn - KX n + Z? - Xg) 

n 

>h<y?)-Y,Hx(t)-Xs{t) + z t (t)) 



t=i 

(a) 



> - log(2vre(l + d t )) - J] - log (27re(E(X(t) - X s (t)) 2 + d t 



t=i 

(b) 
> 



71 77 / >> 

- log(l + di)-- log (Ed{X n , X n s ) + d, 



( c ) n , l + di 
2 D s + di 

where (a) is due to the fact that the entropy of any random variable is upper bounded by that of a Gaussian 
variables with the same variance; (b) is implied by concavity of the function log(x); and in (c) we have 
used the fact that log (a; + a) is an increasing function in x. ■ 
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Proof of Lemma @' Note that 



h{YP\S) - h{Y?\S) = h(Y?\S) - h{YJ\S, Z? - Z] 
^h{Y?\S)-h{Y?\S,Z?-Z") 



= I{Y?-Z?-ZJ\S) 

= h(Z?-Z?\S)-h(Z?-Z?\S,Yn 

> h(Z? - Zf) - h(Z? - Z*\Y? - X$) 

n 

> £ H z i(t) - Z>(t)) - h(Zi{t) - ZjftlYiit) - X s (t)) 
t=i 

n 

= - Z,(t);X(t)-X s (t) + Zi(t)) 

t=i 

Myl lo E(X(t)-X s (t)Y + d t 
~ tT2 ° g E(X(t)-X s (t)) 2 + d, 
ton Ds + dj 

> 77 log (48) 
2 D s + % 

where (a) holds because Yf is independent of Zf — Z™ = N- 1 + • • • + Nj_ t for i < j; the equality in (b) 
is because of Yi = Yj + (Zi — Zf)\ (c) is due to the data processing inequality and the fact that Zf — Z™ is 
purely noise and independent of X n and therefore S; in (d) we use the worst noise lemma in [12], [17]; 
and (e) is due to convexity and monotonicity of log(x + a)/(x + b) in x when a >b. Therefore, we simply 
have 

J(5; YJ 1 ) - I(S; Y?) = h{Y?) - h(YJ\S) - h{Y?) + h(Y?\S) 

n n 1 + dj i n, As + dj 



> — log p H — log 



j 



2 ° 1 + di 2 D s + d 
2 8 (l + ^)(As + ^)' 1 ) 
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